Pandas Profiling Report

Dataset statistics

Number of variables	19
Number of observations	23446
Missing cells	177152
Missing cells (%)	39.8%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	3.6 MiB
Average record size in memory	160.0 B

Variable types

Categorical	1
DateTime	1
Numeric	14
Unsupported	3

Alerts

`specific_conductance` is highly overall correlated with `pH`	High correlation
`DO` is highly overall correlated with `surfwater_mean_temp`	High correlation
`pH` is highly overall correlated with `specific_conductance`	High correlation
`surfwater_mean_temp` is highly overall correlated with `DO`	High correlation
`CH4_conc` is highly overall correlated with `CO2_conc`	High correlation
`CO2_conc` is highly overall correlated with `CH4_conc`	High correlation
`nitrate_mean` has 9397 (40.1%) missing values	Missing
`specific_conductance` has 3833 (16.3%) missing values	Missing
`DO` has 4002 (17.1%) missing values	Missing
`sealevelDO_sat` has 4005 (17.1%) missing values	Missing
`localDO_sat` has 23446 (100.0%) missing values	Missing
`pH` has 3992 (17.0%) missing values	Missing
`chlorophyll` has 3910 (16.7%) missing values	Missing
`chlarelativefluorescence` has 23446 (100.0%) missing values	Missing
`turbidity` has 3858 (16.5%) missing values	Missing
`fDOM` has 5629 (24.0%) missing values	Missing
`surfwater_mean_temp` has 2912 (12.4%) missing values	Missing
`CH4_conc` has 21975 (93.7%) missing values	Missing
`CO2_conc` has 21975 (93.7%) missing values	Missing
`N2O_conc` has 21975 (93.7%) missing values	Missing
`Microbialabundanceper_ml` has 22797 (97.2%) missing values	Missing
`specific_conductance` is highly skewed (γ1 = 20.20168481)	Skewed
`chlorophyll` is highly skewed (γ1 = 46.37723597)	Skewed
`surfwater_mean_temp` is highly skewed (γ1 = 103.435735)	Skewed
`N2O_conc` is highly skewed (γ1 = 27.46463877)	Skewed
`localDO_sat` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`chlarelativefluorescence` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`year_month` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`spectrum_count` has 9458 (40.3%) zeros	Zeros

Reproduction

Analysis started	2023-02-02 21:38:46.988994
Analysis finished	2023-02-02 21:39:01.074345
Duration	14.09 seconds
Software version	ydata-profiling vv4.0.0
Download configuration	config.json

siteid
Categorical

Distinct	24
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	366.3 KiB

ARIK	1096
LECO	1096
WALK	1096
SYCA	1096
PRIN	1096
Other values (19)	17966

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	93784
Distinct characters	21
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	ARIK
2nd row	ARIK
3rd row	ARIK
4th row	ARIK
5th row	ARIK

Common Values

Value	Count	Frequency (%)
ARIK	1096	4.7%
LECO	1096	4.7%
WALK	1096	4.7%
SYCA	1096	4.7%
PRIN	1096	4.7%
POSE	1096	4.7%
MCRA	1096	4.7%
MCDI	1096	4.7%
MAYF	1096	4.7%
LEWI	1096	4.7%
Other values (14)	12486	53.3%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
arik	1096	4.7%
mayf	1096	4.7%
como	1096	4.7%
leco	1096	4.7%
king	1096	4.7%
wlou	1096	4.7%
lewi	1096	4.7%
hopb	1096	4.7%
mcdi	1096	4.7%
mcra	1096	4.7%
Other values (14)	12486	53.3%

Most occurring characters

Value	Count	Frequency (%)
C	8547	9.1%
I	7767	8.3%
E	7644	8.2%
L	7012	7.5%
O	6968	7.4%
A	6922	7.4%
R	6837	7.3%
M	5451	5.8%
B	4692	5.0%
P	4247	4.5%
Other values (11)	27697	29.5%

Most occurring categories

Value	Count	Frequency (%)
Uppercase Letter	93784	100.0%

Most frequent character per category

Uppercase Letter

Value	Count	Frequency (%)
C	8547	9.1%
I	7767	8.3%
E	7644	8.2%
L	7012	7.5%
O	6968	7.4%
A	6922	7.4%
R	6837	7.3%
M	5451	5.8%
B	4692	5.0%
P	4247	4.5%
Other values (11)	27697	29.5%

Most occurring scripts

Value	Count	Frequency (%)
Latin	93784	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
C	8547	9.1%
I	7767	8.3%
E	7644	8.2%
L	7012	7.5%
O	6968	7.4%
A	6922	7.4%
R	6837	7.3%
M	5451	5.8%
B	4692	5.0%
P	4247	4.5%
Other values (11)	27697	29.5%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	93784	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
C	8547	9.1%
I	7767	8.3%
E	7644	8.2%
L	7012	7.5%
O	6968	7.4%
A	6922	7.4%
R	6837	7.3%
M	5451	5.8%
B	4692	5.0%
P	4247	4.5%
Other values (11)	27697	29.5%

date
Date

Distinct	1096
Distinct (%)	4.7%
Missing	0
Missing (%)	0.0%
Memory size	366.3 KiB

Minimum	2018-01-01 00:00:00
Maximum	2020-12-31 00:00:00

Histogram

Histogram with fixed size bins (bins=50)

nitrate_mean
Real number (ℝ)

Distinct	11521
Distinct (%)	82.0%
Missing	9397
Missing (%)	40.1%
Infinite	0
Infinite (%)	0.0%
Mean	22.590674

Minimum	-1
Maximum	851.7
Zeros	3
Zeros (%)	< 0.1%
Negative	546
Negative (%)	2.3%
Memory size	366.3 KiB

Quantile statistics

Minimum	-1
5-th percentile	0.20851648
Q1	2.64375
median	6.19375
Q3	22.146875
95-th percentile	170.13312
Maximum	851.7
Range	852.7
Interquartile range (IQR)	19.503125

Descriptive statistics

Standard deviation	45.782385
Coefficient of variation (CV)	2.0266055
Kurtosis	17.592005
Mean	22.590674
Median Absolute Deviation (MAD)	4.9447917
Skewness	3.6129915
Sum	317376.38
Variance	2096.0268
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-1	47	0.2%
-0.9	10	< 0.1%
3.633333333	7	< 0.1%
1.7	6	< 0.1%
3.3	6	< 0.1%
3.8	6	< 0.1%
2.854166667	6	< 0.1%
2.7	6	< 0.1%
-0.9666666667	6	< 0.1%
6.5	6	< 0.1%
Other values (11511)	13943	59.5%
(Missing)	9397	40.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-1	47	0.2%
-0.9983050847	1	< 0.1%
-0.9925925926	1	< 0.1%
-0.9913043478	1	< 0.1%
-0.9882352941	1	< 0.1%
-0.9857142857	1	< 0.1%
-0.9854545455	1	< 0.1%
-0.9851351351	1	< 0.1%
-0.98	3	< 0.1%
-0.975	3	< 0.1%

Value	Count	Frequency (%)
851.7	1	< 0.1%
493.6	1	< 0.1%
284.4541667	1	< 0.1%
264.3375	1	< 0.1%
261.76875	1	< 0.1%
261.3	1	< 0.1%
260.85625	1	< 0.1%
260.5569231	1	< 0.1%
259.7614583	1	< 0.1%
259.6916667	1	< 0.1%

specific_conductance
Real number (ℝ)

HIGH CORRELATION MISSING SKEWED

Distinct	19600
Distinct (%)	99.9%
Missing	3833
Missing (%)	16.3%
Infinite	0
Infinite (%)	0.0%
Mean	559.3787

Minimum	-0.15208333
Maximum	215585.2
Zeros	0
Zeros (%)	0.0%
Negative	129
Negative (%)	0.6%
Memory size	366.3 KiB

Quantile statistics

Minimum	-0.15208333
5-th percentile	13.001953
Q1	37.487733
median	118.86168
Q3	508.93932
95-th percentile	687.7591
Maximum	215585.2
Range	215585.35
Interquartile range (IQR)	471.45159

Descriptive statistics

Standard deviation	6009.0504
Coefficient of variation (CV)	10.742365
Kurtosis	426.35157
Mean	559.3787
Median Absolute Deviation (MAD)	100.46622
Skewness	20.201685
Sum	10971094
Variance	36108686
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
117989.8333	6	< 0.1%
117992.3333	3	< 0.1%
117973.3333	3	< 0.1%
117990.8333	2	< 0.1%
117989.3333	2	< 0.1%
117978.3333	2	< 0.1%
117988.3333	2	< 0.1%
630.3183681	1	< 0.1%
20.71520081	1	< 0.1%
616.9035382	1	< 0.1%
Other values (19590)	19590	83.6%
(Missing)	3833	16.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-0.1520833333	1	< 0.1%
-0.1425098641	1	< 0.1%
-0.1304875097	1	< 0.1%
-0.1262824675	1	< 0.1%
-0.1221186274	1	< 0.1%
-0.1182964219	1	< 0.1%
-0.1166371419	1	< 0.1%
-0.1155133484	1	< 0.1%
-0.1117497485	1	< 0.1%
-0.1114399395	1	< 0.1%

Value	Count	Frequency (%)
215585.1969	1	< 0.1%
118086.5914	1	< 0.1%
118034.1458	1	< 0.1%
118032.4041	1	< 0.1%
118026.3421	1	< 0.1%
118017.1726	1	< 0.1%
118014.5285	1	< 0.1%
118010.4898	1	< 0.1%
118006.4988	1	< 0.1%
118001.9287	1	< 0.1%

DO
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	19411
Distinct (%)	99.8%
Missing	4002
Missing (%)	17.1%
Infinite	0
Infinite (%)	0.0%
Mean	10.471025

Minimum	-5.65
Maximum	354.97759
Zeros	0
Zeros (%)	0.0%
Negative	3
Negative (%)	< 0.1%
Memory size	366.3 KiB

Quantile statistics

Minimum	-5.65
5-th percentile	4.8833549
Q1	8.2590243
median	9.7186718
Q3	11.150961
95-th percentile	13.215627
Maximum	354.97759
Range	360.62759
Interquartile range (IQR)	2.8919366

Descriptive statistics

Standard deviation	16.137639
Coefficient of variation (CV)	1.5411709
Kurtosis	316.13212
Mean	10.471025
Median Absolute Deviation (MAD)	1.4494398
Skewness	17.493341
Sum	203598.6
Variance	260.42338
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
5.68025	2	< 0.1%
10.92090278	2	< 0.1%
7.922267361	2	< 0.1%
11.87709028	2	< 0.1%
9.407486111	2	< 0.1%
11.61203125	2	< 0.1%
9.6656875	2	< 0.1%
10.18375347	2	< 0.1%
8.873864583	2	< 0.1%
11.49636111	2	< 0.1%
Other values (19401)	19424	82.8%
(Missing)	4002	17.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-5.65	1	< 0.1%
-4.22	1	< 0.1%
-3.4275	1	< 0.1%
0.2234930556	1	< 0.1%
0.2289583333	1	< 0.1%
0.2346944444	1	< 0.1%
0.535875	1	< 0.1%
0.5426909722	1	< 0.1%
0.5442743056	1	< 0.1%
0.5455208333	1	< 0.1%

Value	Count	Frequency (%)
354.9775903	1	< 0.1%
350.844588	1	< 0.1%
350.2903487	1	< 0.1%
348.9448664	1	< 0.1%
345.6860347	1	< 0.1%
344.8827361	1	< 0.1%
344.8493507	1	< 0.1%
343.2838435	1	< 0.1%
342.7693021	1	< 0.1%
339.5286148	1	< 0.1%

sealevelDO_sat
Real number (ℝ)

Distinct	19431
Distinct (%)	99.9%
Missing	4005
Missing (%)	17.1%
Infinite	0
Infinite (%)	0.0%
Mean	85.074722

Minimum	-0.21
Maximum	149.14118
Zeros	0
Zeros (%)	0.0%
Negative	7
Negative (%)	< 0.1%
Memory size	366.3 KiB

Quantile statistics

Minimum	-0.21
5-th percentile	49.103212
Q1	79.177274
median	91.297566
Q3	95.705566
95-th percentile	100.54755
Maximum	149.14118
Range	149.35118
Interquartile range (IQR)	16.528292

Descriptive statistics

Standard deviation	17.183113
Coefficient of variation (CV)	0.20197672
Kurtosis	5.5205545
Mean	85.074722
Median Absolute Deviation (MAD)	5.8905039
Skewness	-2.1003772
Sum	1653937.7
Variance	295.25937
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
94.09083333	2	< 0.1%
94.83295139	2	< 0.1%
61.44536458	2	< 0.1%
95.57340972	2	< 0.1%
95.22639931	2	< 0.1%
98.59803472	2	< 0.1%
96.51315972	2	< 0.1%
93.8940625	2	< 0.1%
-0.21	2	< 0.1%
93.98849306	2	< 0.1%
Other values (19421)	19421	82.8%
(Missing)	4005	17.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-0.21	2	< 0.1%
-0.19	1	< 0.1%
-0.14	1	< 0.1%
-0.115	1	< 0.1%
-0.11	1	< 0.1%
-0.04	1	< 0.1%
0.02	1	< 0.1%
2.288666667	1	< 0.1%
2.297881944	1	< 0.1%
2.308645833	1	< 0.1%

Value	Count	Frequency (%)
149.1411765	1	< 0.1%
148.9765208	1	< 0.1%
139.1314931	1	< 0.1%
137.623235	1	< 0.1%
122.77996	1	< 0.1%
122.3434653	1	< 0.1%
120.336537	1	< 0.1%
119.5040933	1	< 0.1%
119.3185	1	< 0.1%
118.3817465	1	< 0.1%

localDO_sat
Unsupported

MISSING REJECTED UNSUPPORTED

Missing	23446
Missing (%)	100.0%
Memory size	366.3 KiB

pH
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	19302
Distinct (%)	99.2%
Missing	3992
Missing (%)	17.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.2566606

Minimum	-148.42144
Maximum	180.16242
Zeros	0
Zeros (%)	0.0%
Negative	140
Negative (%)	0.6%
Memory size	366.3 KiB

Quantile statistics

Minimum	-148.42144
5-th percentile	5.7261533
Q1	7.1420248
median	7.6251458
Q3	7.9781875
95-th percentile	8.3359217
Maximum	180.16242
Range	328.58386
Interquartile range (IQR)	0.83616267

Descriptive statistics

Standard deviation	6.7242064
Coefficient of variation (CV)	0.92662545
Kurtosis	278.3843
Mean	7.2566606
Median Absolute Deviation (MAD)	0.40646354
Skewness	-8.4017295
Sum	141171.08
Variance	45.214952
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8.123048611	3	< 0.1%
7.965013889	3	< 0.1%
0.04	3	< 0.1%
7.305177083	2	< 0.1%
7.968704861	2	< 0.1%
7.977076389	2	< 0.1%
7.985086806	2	< 0.1%
7.336493056	2	< 0.1%
8.080402778	2	< 0.1%
8.055451389	2	< 0.1%
Other values (19292)	19431	82.9%
(Missing)	3992	17.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-148.421441	1	< 0.1%
-115.6593542	1	< 0.1%
-110.3337083	1	< 0.1%
-106.9238056	1	< 0.1%
-105.0351042	1	< 0.1%
-104.8037535	1	< 0.1%
-104.7387639	1	< 0.1%
-104.5517639	1	< 0.1%
-104.5385	1	< 0.1%
-104.5080174	1	< 0.1%

Value	Count	Frequency (%)
180.1624167	1	< 0.1%
178.2650833	1	< 0.1%
176.5400653	1	< 0.1%
175.7289896	1	< 0.1%
72.91786458	1	< 0.1%
56.03611111	1	< 0.1%
54.62387153	1	< 0.1%
54.36675	1	< 0.1%
54.31365278	1	< 0.1%
53.59072569	1	< 0.1%

chlorophyll
Real number (ℝ)

MISSING SKEWED

Distinct	19403
Distinct (%)	99.3%
Missing	3910
Missing (%)	16.7%
Infinite	0
Infinite (%)	0.0%
Mean	41.104601

Minimum	-12043.857
Maximum	59462.899
Zeros	105
Zeros (%)	0.4%
Negative	1132
Negative (%)	4.8%
Memory size	366.3 KiB

Quantile statistics

Minimum	-12043.857
5-th percentile	-0.020173248
Q1	0.4556276
median	1.2474192
Q3	4.2909149
95-th percentile	102.58862
Maximum	59462.899
Range	71506.755
Interquartile range (IQR)	3.8352873

Descriptive statistics

Standard deviation	1024.7074
Coefficient of variation (CV)	24.929264
Kurtosis	2343.3533
Mean	41.104601
Median Absolute Deviation (MAD)	1.0461337
Skewness	46.377236
Sum	803019.49
Variance	1050025.3
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	105	0.4%
0.0165	2	< 0.1%
0.3226840278	2	< 0.1%
1.859986111	2	< 0.1%
0.4584201389	2	< 0.1%
0.4582569444	2	< 0.1%
0.7244444444	2	< 0.1%
0.2514375	2	< 0.1%
0.4868472222	2	< 0.1%
0.06290625	2	< 0.1%
Other values (19393)	19413	82.8%
(Missing)	3910	16.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-12043.8566	1	< 0.1%
-4668.906243	1	< 0.1%
-3208.867799	1	< 0.1%
-3205.274562	1	< 0.1%
-3052.578439	1	< 0.1%
-2807.758331	1	< 0.1%
-1645.977826	1	< 0.1%
-1478.561921	1	< 0.1%
-1290.922361	1	< 0.1%
-1183.380573	1	< 0.1%

Value	Count	Frequency (%)
59462.8986	1	< 0.1%
58945.07041	1	< 0.1%
54365.8061	1	< 0.1%
53169.06921	1	< 0.1%
47121.93829	1	< 0.1%
35084.85759	1	< 0.1%
31630.10413	1	< 0.1%
27480.42869	1	< 0.1%
26948.5032	1	< 0.1%
25381.5971	1	< 0.1%

chlarelativefluorescence
Unsupported

MISSING REJECTED UNSUPPORTED

Missing	23446
Missing (%)	100.0%
Memory size	366.3 KiB

turbidity
Real number (ℝ)

Distinct	19577
Distinct (%)	99.9%
Missing	3858
Missing (%)	16.5%
Infinite	0
Infinite (%)	0.0%
Mean	57.285627

Minimum	-27301.296
Maximum	11043.457
Zeros	1
Zeros (%)	< 0.1%
Negative	3383
Negative (%)	14.4%
Memory size	366.3 KiB

Quantile statistics

Minimum	-27301.296
5-th percentile	-3.7620175
Q1	0.50782551
median	1.8504705
Q3	9.3409201
95-th percentile	207.67363
Maximum	11043.457
Range	38344.753
Interquartile range (IQR)	8.8330946

Descriptive statistics

Standard deviation	422.82847
Coefficient of variation (CV)	7.381057
Kurtosis	1086.686
Mean	57.285627
Median Absolute Deviation (MAD)	2.5844201
Skewness	-3.7208688
Sum	1122110.9
Variance	178783.92
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.525625	2	< 0.1%
0.1822881944	2	< 0.1%
2.130086806	2	< 0.1%
2.357190972	2	< 0.1%
1.389895833	2	< 0.1%
1.531225694	2	< 0.1%
0.4978020833	2	< 0.1%
7.893503472	2	< 0.1%
2.869972222	2	< 0.1%
2.459128472	2	< 0.1%
Other values (19567)	19568	83.5%
(Missing)	3858	16.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-27301.29578	1	< 0.1%
-6862.923271	1	< 0.1%
-3195.010385	1	< 0.1%
-1250.391348	1	< 0.1%
-950.2015139	1	< 0.1%
-724.3873333	1	< 0.1%
-698.9657569	1	< 0.1%
-652.7575521	1	< 0.1%
-103.1050837	1	< 0.1%
-60.69411458	1	< 0.1%

Value	Count	Frequency (%)
11043.45684	1	< 0.1%
10727.07897	1	< 0.1%
10554.77311	1	< 0.1%
10257.78202	1	< 0.1%
10022.43098	1	< 0.1%
9699.25307	1	< 0.1%
9003.368333	1	< 0.1%
8361.376756	1	< 0.1%
7901.04174	1	< 0.1%
7672.896052	1	< 0.1%

fDOM
Real number (ℝ)

Distinct	17797
Distinct (%)	99.9%
Missing	5629
Missing (%)	24.0%
Infinite	0
Infinite (%)	0.0%
Mean	25.211668

Minimum	-181.64178
Maximum	683.04393
Zeros	0
Zeros (%)	0.0%
Negative	1577
Negative (%)	6.7%
Memory size	366.3 KiB

Quantile statistics

Minimum	-181.64178
5-th percentile	-1.5130534
Q1	4.5213097
median	13.594332
Q3	32.539527
95-th percentile	83.437978
Maximum	683.04393
Range	864.68572
Interquartile range (IQR)	28.018217

Descriptive statistics

Standard deviation	39.751483
Coefficient of variation (CV)	1.5767097
Kurtosis	49.98873
Mean	25.211668
Median Absolute Deviation (MAD)	11.541332
Skewness	5.2986381
Sum	449196.29
Variance	1580.1804
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
9.234263889	2	< 0.1%
15.45	2	< 0.1%
0.6370763889	2	< 0.1%
17.15	2	< 0.1%
4.34	2	< 0.1%
16.25	2	< 0.1%
0.5123611111	2	< 0.1%
6.532826389	2	< 0.1%
-2.55	2	< 0.1%
3.26	2	< 0.1%
Other values (17787)	17797	75.9%
(Missing)	5629	24.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-181.6417847	1	< 0.1%
-68.17801389	1	< 0.1%
-67.88182639	1	< 0.1%
-67.8706875	1	< 0.1%
-67.79990278	1	< 0.1%
-67.43822222	1	< 0.1%
-67.30304167	1	< 0.1%
-67.29336806	1	< 0.1%
-66.59643056	1	< 0.1%
-66.52503472	1	< 0.1%

Value	Count	Frequency (%)
683.0439306	1	< 0.1%
636.10975	1	< 0.1%
615.15625	1	< 0.1%
610.4070737	1	< 0.1%
605.4689167	1	< 0.1%
598.6687222	1	< 0.1%
587.8141319	1	< 0.1%
587.4855278	1	< 0.1%
583.7215229	1	< 0.1%
556.1297315	1	< 0.1%

spectrum_count
Real number (ℝ)

Distinct	2897
Distinct (%)	12.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16.146151

Minimum	0
Maximum	197.09306
Zeros	9458
Zeros (%)	40.3%
Negative	0
Negative (%)	0.0%
Memory size	366.3 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	19.173611
Q3	20
95-th percentile	50
Maximum	197.09306
Range	197.09306
Interquartile range (IQR)	20

Descriptive statistics

Standard deviation	23.208483
Coefficient of variation (CV)	1.4374004
Kurtosis	11.926772
Mean	16.146151
Median Absolute Deviation (MAD)	19.173611
Skewness	3.0788834
Sum	378562.65
Variance	538.63369
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	9458	40.3%
20	8234	35.1%
50	1158	4.9%
19.79166667	91	0.4%
4	74	0.3%
19.98958333	54	0.2%
19.58333333	42	0.2%
19.375	37	0.2%
0.2083333333	33	0.1%
19.97916667	32	0.1%
Other values (2887)	4233	18.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	9458	40.3%
0.0003472222222	2	< 0.1%
0.0006944444444	1	< 0.1%
0.001388888889	1	< 0.1%
0.006944444444	1	< 0.1%
0.009375	1	< 0.1%
0.01041666667	6	< 0.1%
0.01319444444	1	< 0.1%
0.01388888889	1	< 0.1%
0.01666666667	1	< 0.1%

Value	Count	Frequency (%)
197.0930556	1	< 0.1%
191.2104167	1	< 0.1%
189.0201389	1	< 0.1%
183.2590278	1	< 0.1%
182.9736111	1	< 0.1%
182.7326389	1	< 0.1%
151.8131944	1	< 0.1%
150.5180556	1	< 0.1%
149.18125	1	< 0.1%
149.0194444	1	< 0.1%

surfwater_mean_temp
Real number (ℝ)

HIGH CORRELATION MISSING SKEWED

Distinct	20529
Distinct (%)	> 99.9%
Missing	2912
Missing (%)	12.4%
Infinite	0
Infinite (%)	0.0%
Mean	972.10857

Minimum	-766.49624
Maximum	10858768
Zeros	0
Zeros (%)	0.0%
Negative	1156
Negative (%)	4.9%
Memory size	366.3 KiB

Quantile statistics

Minimum	-766.49624
5-th percentile	-0.015117281
Q1	4.6625636
median	10.885853
Q3	17.898046
95-th percentile	24.158209
Maximum	10858768
Range	10859535
Interquartile range (IQR)	13.235482

Descriptive statistics

Standard deviation	96250.57
Coefficient of variation (CV)	99.01216
Kurtosis	10845.334
Mean	972.10857
Median Absolute Deviation (MAD)	6.6263996
Skewness	103.43574
Sum	19961277
Variance	9.2641721 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.2499419643	2	< 0.1%
24.58464583	2	< 0.1%
5.877383929	2	< 0.1%
11.71277679	2	< 0.1%
7.96258631	2	< 0.1%
7.035794643	1	< 0.1%
8.443063988	1	< 0.1%
6.969447917	1	< 0.1%
8.008286018	1	< 0.1%
7.920174107	1	< 0.1%
Other values (20519)	20519	87.5%
(Missing)	2912	12.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-766.4962381	1	< 0.1%
-716.220872	1	< 0.1%
-502.5662798	1	< 0.1%
-292.9203244	1	< 0.1%
-288.4305387	1	< 0.1%
-281.5613869	1	< 0.1%
-279.7228006	1	< 0.1%
-276.7377232	1	< 0.1%
-276.0710833	1	< 0.1%
-268.0691042	1	< 0.1%

Value	Count	Frequency (%)
10858768.05	1	< 0.1%
8498233.042	1	< 0.1%
326642.3714	1	< 0.1%
28115.55707	1	< 0.1%
15320.89555	1	< 0.1%
10638.88077	1	< 0.1%
469.0470132	1	< 0.1%
428.1937857	1	< 0.1%
342.9852649	1	< 0.1%
261.1095417	1	< 0.1%

year_month
Unsupported

REJECTED UNSUPPORTED

Missing	0
Missing (%)	0.0%
Memory size	366.3 KiB

CH4_conc
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	1471
Distinct (%)	100.0%
Missing	21975
Missing (%)	93.7%
Infinite	0
Infinite (%)	0.0%
Mean	14.229912

Minimum	0.98494075
Maximum	1795.692
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	366.3 KiB

Quantile statistics

Minimum	0.98494075
5-th percentile	1.7719437
Q1	2.2462129
median	2.9154175
Q3	6.537037
95-th percentile	43.872397
Maximum	1795.692
Range	1794.7071
Interquartile range (IQR)	4.2908241

Descriptive statistics

Standard deviation	69.405083
Coefficient of variation (CV)	4.8774076
Kurtosis	350.57312
Mean	14.229912
Median Absolute Deviation (MAD)	0.95267747
Skewness	16.350438
Sum	20932.201
Variance	4817.0655
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.1144756	1	< 0.1%
2.06407175	1	< 0.1%
1.723966	1	< 0.1%
1.7741433	1	< 0.1%
2.2400565	1	< 0.1%
2.0337949	1	< 0.1%
1.99267845	1	< 0.1%
1.94605775	1	< 0.1%
1.9652251	1	< 0.1%
2.1604141	1	< 0.1%
Other values (1461)	1461	6.2%
(Missing)	21975	93.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.98494075	1	< 0.1%
1.14367275	1	< 0.1%
1.1456277	1	< 0.1%
1.1575606	1	< 0.1%
1.1919986	1	< 0.1%
1.2387358	1	< 0.1%
1.25669625	1	< 0.1%
1.2924489	1	< 0.1%
1.3088367	1	< 0.1%
1.33234565	1	< 0.1%

Value	Count	Frequency (%)
1795.692045	1	< 0.1%
1099.988239	1	< 0.1%
658.8522525	1	< 0.1%
625.1824908	1	< 0.1%
522.2641439	1	< 0.1%
507.196405	1	< 0.1%
446.3837544	1	< 0.1%
413.8323269	1	< 0.1%
343.2472323	1	< 0.1%
327.7892796	1	< 0.1%

CO2_conc
Real number (ℝ)

HIGH CORRELATION MISSING

Distinct	1471
Distinct (%)	100.0%
Missing	21975
Missing (%)	93.7%
Infinite	0
Infinite (%)	0.0%
Mean	1270.005

Minimum	451.65826
Maximum	12480.499
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	366.3 KiB

Quantile statistics

Minimum	451.65826
5-th percentile	573.72323
Q1	721.63625
median	919.05709
Q3	1300.3328
95-th percentile	3236.6187
Maximum	12480.499
Range	12028.841
Interquartile range (IQR)	578.69653

Descriptive statistics

Standard deviation	1182.4906
Coefficient of variation (CV)	0.93109129
Kurtosis	25.410466
Mean	1270.005
Median Absolute Deviation (MAD)	242.33339
Skewness	4.4291735
Sum	1868177.3
Variance	1398284
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
697.1785662	1	< 0.1%
941.6299162	1	< 0.1%
923.5231602	1	< 0.1%
620.2914126	1	< 0.1%
710.8935514	1	< 0.1%
612.0101796	1	< 0.1%
552.3072795	1	< 0.1%
694.8649211	1	< 0.1%
724.939462	1	< 0.1%
632.2737526	1	< 0.1%
Other values (1461)	1461	6.2%
(Missing)	21975	93.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
451.658259	1	< 0.1%
465.3519152	1	< 0.1%
471.3964059	1	< 0.1%
487.1799353	1	< 0.1%
488.551533	1	< 0.1%
488.6288924	1	< 0.1%
496.7575391	1	< 0.1%
498.0666387	1	< 0.1%
498.330625	1	< 0.1%
503.2026078	1	< 0.1%

Value	Count	Frequency (%)
12480.49888	1	< 0.1%
11310.68249	1	< 0.1%
11306.36511	1	< 0.1%
10007.02552	1	< 0.1%
9344.265345	1	< 0.1%
9115.481392	1	< 0.1%
8602.955041	1	< 0.1%
8539.139887	1	< 0.1%
8470.422789	1	< 0.1%
8467.017459	1	< 0.1%

N2O_conc
Real number (ℝ)

MISSING SKEWED

Distinct	1471
Distinct (%)	100.0%
Missing	21975
Missing (%)	93.7%
Infinite	0
Infinite (%)	0.0%
Mean	0.64287659

Minimum	0.1848145
Maximum	50.816405
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	366.3 KiB

Quantile statistics

Minimum	0.1848145
5-th percentile	0.32119398
Q1	0.43221318
median	0.5223865
Q3	0.6644633
95-th percentile	1.0237796
Maximum	50.816405
Range	50.63159
Interquartile range (IQR)	0.23225012

Descriptive statistics

Standard deviation	1.5812658
Coefficient of variation (CV)	2.4596725
Kurtosis	804.53926
Mean	0.64287659
Median Absolute Deviation (MAD)	0.114229
Skewness	27.464639
Sum	945.67146
Variance	2.5004016
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.55989035	1	< 0.1%
0.42812065	1	< 0.1%
0.50948535	1	< 0.1%
0.5682762	1	< 0.1%
0.4120205	1	< 0.1%
0.4341768	1	< 0.1%
0.43389515	1	< 0.1%
0.41211845	1	< 0.1%
0.44212555	1	< 0.1%
0.50498115	1	< 0.1%
Other values (1461)	1461	6.2%
(Missing)	21975	93.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.1848145	1	< 0.1%
0.21246945	1	< 0.1%
0.21812315	1	< 0.1%
0.22561035	1	< 0.1%
0.2277536	1	< 0.1%
0.2387321	1	< 0.1%
0.24403455	1	< 0.1%
0.2460871	1	< 0.1%
0.2520539	1	< 0.1%
0.25247145	1	< 0.1%

Value	Count	Frequency (%)
50.8164046	1	< 0.1%
32.67810045	1	< 0.1%
6.1993433	1	< 0.1%
2.86720455	1	< 0.1%
2.70986205	1	< 0.1%
2.5122613	1	< 0.1%
2.4494767	1	< 0.1%
2.41977485	1	< 0.1%
2.1035131	1	< 0.1%
1.997072	1	< 0.1%

Microbialabundanceper_ml
Real number (ℝ)

Distinct	606
Distinct (%)	93.4%
Missing	22797
Missing (%)	97.2%
Infinite	0
Infinite (%)	0.0%
Mean	1883205.5

Minimum	3361.1111
Maximum	62606310
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	366.3 KiB

Quantile statistics

Minimum	3361.1111
5-th percentile	43114
Q1	155075.56
median	313511.11
Q3	832772.22
95-th percentile	9140058
Maximum	62606310
Range	62602949
Interquartile range (IQR)	677696.67

Descriptive statistics

Standard deviation	6284089.7
Coefficient of variation (CV)	3.3369113
Kurtosis	46.321372
Mean	1883205.5
Median Absolute Deviation (MAD)	207674.44
Skewness	6.2900801
Sum	1.2222004 × 10⁹
Variance	3.9489783 × 10¹³
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
295747.7778	4	< 0.1%
458984.4444	3	< 0.1%
75857.77778	3	< 0.1%
576132.2222	3	< 0.1%
165637.7778	3	< 0.1%
1281893.333	2	< 0.1%
1254046.667	2	< 0.1%
2467764.444	2	< 0.1%
187243.3333	2	< 0.1%
184842.2222	2	< 0.1%
Other values (596)	623	2.7%
(Missing)	22797	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
3361.111111	1	< 0.1%
4548.888889	1	< 0.1%
9002.222222	1	< 0.1%
9048.888889	1	< 0.1%
12447.77778	1	< 0.1%
12975.55556	1	< 0.1%
13443.33333	1	< 0.1%
14207.77778	1	< 0.1%
16585.55556	1	< 0.1%
17764.44444	1	< 0.1%

Value	Count	Frequency (%)
62606310	1	< 0.1%
61982167.78	1	< 0.1%
59389574.44	1	< 0.1%
39993141.11	1	< 0.1%
39849108.89	1	< 0.1%
39465021.11	1	< 0.1%
35361682.22	1	< 0.1%
32692272.22	1	< 0.1%
32397805.56	1	< 0.1%
30390946.67	1	< 0.1%

Auto

Heatmap
Table

	nitrate_mean	specific_conductance	DO	sealevelDO_sat	pH	chlorophyll	turbidity	fDOM	spectrum_count	surfwater_mean_temp	CH4_conc	CO2_conc	N2O_conc	Microbialabundanceper_ml	siteid
nitrate_mean	1.000	0.411	-0.079	0.229	0.333	0.288	0.295	0.139	0.031	0.290	0.238	0.219	0.025	0.061	0.441
specific_conductance	0.411	1.000	-0.282	-0.180	0.638	0.246	0.047	0.132	0.096	0.250	0.375	0.487	0.082	0.097	0.113
DO	-0.079	-0.282	1.000	0.472	-0.145	-0.159	-0.163	-0.050	0.042	-0.719	-0.323	-0.440	-0.261	-0.281	0.111
sealevelDO_sat	0.229	-0.180	0.472	1.000	-0.032	-0.186	-0.041	-0.269	-0.079	0.087	-0.211	-0.248	-0.137	-0.228	0.410
pH	0.333	0.638	-0.145	-0.032	1.000	0.161	0.045	-0.027	0.114	0.140	0.078	0.200	0.056	-0.058	0.141
chlorophyll	0.288	0.246	-0.159	-0.186	0.161	1.000	0.342	0.291	-0.018	0.061	0.260	0.194	0.027	0.164	0.036
turbidity	0.295	0.047	-0.163	-0.041	0.045	0.342	1.000	0.103	0.038	0.210	0.256	0.193	0.008	0.294	0.055
fDOM	0.139	0.132	-0.050	-0.269	-0.027	0.291	0.103	1.000	0.058	-0.112	0.292	0.042	-0.025	0.369	0.147
spectrum_count	0.031	0.096	0.042	-0.079	0.114	-0.018	0.038	0.058	1.000	-0.099	-0.009	0.070	0.044	0.028	0.206
surfwater_mean_temp	0.290	0.250	-0.719	0.087	0.140	0.061	0.210	-0.112	-0.099	1.000	0.311	0.412	0.163	0.163	0.000
CH4_conc	0.238	0.375	-0.323	-0.211	0.078	0.260	0.256	0.292	-0.009	0.311	1.000	0.638	0.106	0.356	0.122
CO2_conc	0.219	0.487	-0.440	-0.248	0.200	0.194	0.193	0.042	0.070	0.412	0.638	1.000	0.227	0.191	0.277
N2O_conc	0.025	0.082	-0.261	-0.137	0.056	0.027	0.008	-0.025	0.044	0.163	0.106	0.227	1.000	-0.060	0.047
Microbialabundanceper_ml	0.061	0.097	-0.281	-0.228	-0.058	0.164	0.294	0.369	0.028	0.163	0.356	0.191	-0.060	1.000	0.124
siteid	0.441	0.113	0.111	0.410	0.141	0.036	0.055	0.147	0.206	0.000	0.122	0.277	0.047	0.124	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

First rows
Last rows

	siteid	date	nitrate_mean	specific_conductance	DO	sealevelDO_sat	localDO_sat	pH	chlorophyll	chlarelativefluorescence	turbidity	fDOM	surfwater_mean_temp	year_month	CH4_conc	CO2_conc	N2O_conc	Microbialabundanceper_ml
0	ARIK	2018-01-01	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	2018-01	NaN	NaN	NaN	NaN
1	ARIK	2018-01-02	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	2018-01	NaN	NaN	NaN	NaN
2	ARIK	2018-01-03	13.700000	539.059444	10.186389	70.760278	NaN	7.822500	2.095000	NaN	2.899444	NaN	-3.679846	2018-01	NaN	NaN	NaN	NaN
3	ARIK	2018-01-04	12.535417	546.480042	9.921785	68.998222	NaN	7.812403	3.249465	NaN	60.369840	NaN	-3.558881	2018-01	21.765665	1340.94266	0.465664	52674.444444
4	ARIK	2018-01-05	10.310417	550.830208	9.721729	67.718958	NaN	7.826743	5.565236	NaN	2.548007	NaN	-3.313589	2018-01	NaN	NaN	NaN	NaN
5	ARIK	2018-01-06	9.966667	535.343569	10.060528	70.384347	NaN	7.839222	8.422056	NaN	33.219167	NaN	-3.084875	2018-01	NaN	NaN	NaN	NaN
6	ARIK	2018-01-07	9.207292	503.494465	10.333701	73.493687	NaN	7.883479	9.204167	NaN	3.417035	NaN	-2.470387	2018-01	NaN	NaN	NaN	NaN
7	ARIK	2018-01-08	8.103125	486.388582	10.645000	74.667076	NaN	7.909354	12.090326	NaN	19.399326	45.22	-2.780479	2018-01	NaN	NaN	NaN	NaN
8	ARIK	2018-01-09	7.708333	475.402592	10.650715	76.021264	NaN	7.929910	43.929736	NaN	4.278028	NaN	-2.127821	2018-01	NaN	NaN	NaN	NaN
9	ARIK	2018-01-10	6.932292	467.588493	10.577743	75.678729	NaN	7.947944	30.268646	NaN	11.884910	NaN	-1.968839	2018-01	NaN	NaN	NaN	NaN

	siteid	date	nitrate_mean	specific_conductance	DO	sealevelDO_sat	localDO_sat	pH	chlorophyll	chlarelativefluorescence	turbidity	fDOM	spectrum_count	surfwater_mean_temp	year_month	CH4_conc	CO2_conc	N2O_conc	Microbialabundanceper_ml
23436	WLOU	2020-12-22	3.808333	110.893983	10.414507	71.691434	NaN	8.093003	1.344167	NaN	1.889278	4.581035	20.000000	0.181159	2020-12	NaN	NaN	NaN	NaN
23437	WLOU	2020-12-23	3.822917	111.120556	10.408309	71.352882	NaN	8.104146	0.989441	NaN	4.469233	4.638299	20.000000	0.039543	2020-12	NaN	NaN	NaN	NaN
23438	WLOU	2020-12-24	3.650000	111.481869	10.495976	71.919857	NaN	8.103500	0.928238	NaN	2.389750	4.518500	0.214931	0.020717	2020-12	NaN	NaN	NaN	NaN
23439	WLOU	2020-12-25	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23440	WLOU	2020-12-26	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23441	WLOU	2020-12-27	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23442	WLOU	2020-12-28	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23443	WLOU	2020-12-29	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23444	WLOU	2020-12-30	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN
23445	WLOU	2020-12-31	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.000000	NaN	2020-12	NaN	NaN	NaN	NaN

Overview

Variables

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Uppercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Missing values

Sample